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An  increase  in  the  initial  number  of  unknowns  at  the  expense  of  arti¬ 
ficial  variables  can  be  avoided  when  constructing  an  initial  solution  for 
the  general  linear  programming  problem  if  a  natural  initial  solution  and 
the  optimization  are  carried  out  in  accordance  with  primal  and  dual  cri¬ 
teria.  For  the  sensitivity  analysis  of  the  optimal  solution  in  the  primal 
problem  with  regard  to  changes  in  the  free  terms  which  enter  the  constraints 
one  must  remember  the  manner  in  which  the  initial  solution  was  constructed. 


1.  The  Natural  Initial  Solution 

By  a  natural  initial  solution  of  the  general  linear  programming  prob¬ 
lem,  we  mean  a  basic  solution  which  consists  only  of  the  initial  unknown 
variables  and  those  additional  variables  which  are  used  to  convert  inequal¬ 
ities  into  equalities. 

A  natural  initial  solution  can  be  constructed  and  used  in  the  following 
manner . 

When  inequalities  of  the  type 

0  <  />  •'  Su.x, 

■  i 

are  included  in  the  initial  simplex  matrix  without  using  an  artificial  var¬ 
iable  but  in  the  form  of  an  inequality  with  the  appropriate  sign 

-  -  6  -  V;  a,  x, 

,  \ 


we  apply  an  algorithm  in  which  optimization  takes  place  in  accordance  with 
the  primal  and  the  dual  criteria.  "According  to  S.  Gass  [1]  there  exist 
sufficiently  effective  methods  of  solving  the  general  linear  programming 
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problem  which  are  based  on  a  combined  usage  of  the  general  simplex  oper¬ 
ation  and  the  dual  method  (p.  178).  Among  the  bibiographical  references 
given  by  Gass,  there  is  no  reference  to  the  work  of  Geisen  which  deals  with 
the  composite  simplex  operation  [2], 

To  avoid  the  artificial  variables  in  the  equations  while  constructing 
an  initial  basic  solution,  one  can  apply  together  with  the  simplex  algorithm 
the  method  of  successive  eliminations.  In  fact  optimization  according  to 
the  dual  criterion  removes  negative  free  terms  which  can  occur  during  the 
construction  of  the  initial  basic  solution  and  contradictory  and  linearly 
dependent  equality  constraints  are  detected  in  the  course  of  the  elimination. 

I.  Kalikhman  on  pages  264-269  of  his  text  [3]  applies  in  an  example 
together  with  the  general  simplex  method  the  method  of  successive  elimina¬ 
tion  in  the  construction  of  an  initial  basic  solution.  Unfortunately,  he 
does  not  warn  the  reader  about  the  possibility  of  the  difficulties  which 
can  arise  and  which  have  been  described  above,  namely,  the  negativity  of  the 
free  terms  and  the  linear  dependence  of  linear  forms. 


2.  Matrix  Representation  of  the  Solution  Process 

We  represent  the  above  solution  process  in  matrix  form.  We  will  de¬ 
note  the  coefficient  matrix  of  the  objective  function  and  the  constraints 
of  the  linear  programming  problem  in  the  following  form: 


I  ^*0*1  Eg  f qxim-q)  Bqxm  D  j 

|  @{m  q)yq  Em-  q  B q)ym  O  I 


or 


[PEFDD 
A  ~  j  P  3  ¥  B  T) 


Here  the  elements  of  the  first  row  of  the  block  matrix  A  consist  of  the 
coefficients  of  the  objective  function  and  former  inequalities  which  have 
been  converted  into  equalities,  and  the  elements  of  the  second  row  are  the 
coefficients  of  the  equalities.  Here  P  is  the  column  of  free  terms,  E  is 
the  identity  matrix,  and  0  is  the  null  matrix,  F  are  columns  which  are  trans¬ 
formed  into  unit  columns  when  constructing  the  natural  initial  solution, 

B  are  columns  which  enter  the  optimum  basisl;  and  D  are  the  remaining  col- 

1  Some  columns  of  matrix  B  can  also  reappear  in  matrices  E  and  F. 


umns . 


To  obtain  a  natural  initial  solution  it  suffices  to  compute  QA,  where 


Q  = 


E 

6 


(2) 


In  fact, 


QA  = 


P  —  FF  ‘  P  E  O  B  —  FF'B  D—FF'd' 

F'F  <5  F  T~'E  F-'B 


t 


(3) 


or 


QA  —  (P  mxl  Err 


Bn 


D) 


(4> 


In  practice  multiplication  by  Q  takes  place  through  m~~q  elimina¬ 
tions  of  the  unknowns. 

To  obtain  the  optimum  solution,  we  multiply  the  matrix  QA  by  the 
matrix  g-A  t  i.e.  we  carry  out  a  simplex  transformation 

A  A  A  A  AAA 

8~'  QA  =  (B~'  P  B-'  E  B-'D ),  (3) 


A  A 

where  the  column  BlP  is  the  optimum  solution. 


3.  Sensitivity  Analysis  of  the  Optimum  Solution  Using  a  Natural  Initial 
Solution 

When  applying  a  natural  initial  solution  on  the  basis  of  the  simplex 
matrix  (5),  in  general,  one  cannot  obtain  immediately  the  optimal  solution 
to  the  dual  problem,  as  mentioned  by  Kalikhman  [3].  To  achieve  this  he 
proposes  two  methods.  The  first  of  these  requires,  in  addition  to  solv.ing 
the  initial  problemjthe  solution  of  a  system  of  m-1  linear  equations  in 
m-1  unknowns,  and  the  second  requires  the  inversion  of  a  matrix  of  order 
m-1 . 


We  will  show  a  method  for  obtaining  the  solution  for  the  dual  problem 
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with  a  natural  initial  solution  which  requires  considerably  less  effort 
than  the  methods  proposed  by  Kalikhman. 

In  the  case  of  the  general  simplex  method,  a  sensitivity  analysis  of 
the  solution  to  the  primal  problem  can  be  carried  out  with  the  aid  of  the 
dual  problem.  We  will  investigate  the  question  how  the  changes  in  the  free 
terms  of  the  initial  system  of  constraints  affect  the  optimal  solution  of 
the  primal  problem  when  the  composite  simplex  method  with  a  natural  initial 
solution  is  used.  Clearly  the  vector  increment  iP  of  the  column  of  free 
terms  can  only  change  the  first  column  of  matrices  1,  3,  4,  and  5.  We 
decompose  AP  into  a  sum  of  two  terms: 


A P  =  A P  -t  \P, 

where 


|  A  P 

0 

1  o 

and 

A  P  = 

A  P 

(6) 


First  we  investigate  the  effects  of  the  increment  AP,  i.e.  the  effects 
of  the  changes  in  the  free  terms  of  the  inequalities.  Since  the  first 
column  of  matrix  A  assumes  now  the  form 


P+  A  P\ 


the  first  column  of  Q/l  will  be 


p  f  A /»  —  FT-'  P 

T  '? 
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or,  according  to  (3)  and  (4) 


/ 


P-f-  AP. 


For  the  first  column  of  matrix  B'1  QA  we  shall  now  have  B  'P-{-  _f- /}  ‘AP, 
i.e.  the  optimum  solution  fj-i  p  has  an  increment 

B  'AP. 

which  is  easily  computed  on  the  basis  of  (5)  and  (6). 

Second,  we  will  investigate  the  effect  of  the  increment  P,  i.e.  the 
effect  of  changes  in  the  free  terms  of  the  equalities  on  the  optimum  sol¬ 
ution  to  the  problem.  Since  the  first  column  of  matrix  A  has  now  the  form 


P 

P  +  AP 


the  first  column  of  matrix  QA  will  be 


j  P  —  FF  *(P  ,  AP) 
!  r  '(P-rAP) 


or,  according  to  (2),  (3),  and  (4),  P  +  QAP,  where 


i 

QAP=  | 

i 


-  FP-'AP 


F-'AP 


) 


(fi> 


A  A 

Instead  of  the  first  column  of  matrix  B  'QA  we  now  have  §  i p  p  \q\p 
i.e.  the  optimum  solution  #  i p  has  an  increment 


B  'Q\P. 


In  this  increment  we  have  the  factor  Q,  which  does  not  appear  as  an  element 
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in  the  final  matrix  (5) .  To  obtain  Q  we  must  retain  the  transformations 
which  were  carried  out  in  constructing  the  natural  initial  solution.  Be¬ 
cause  of  (2)  and  (6)  we  need  only  retain  the  second  column  of  the  matrix. 

If  we,  augment  the  matrix  A  by  the  column* 


(9) 


then  the  second  column  of  the  matrix  Q  is  added  to  the  matrix  QA: 


1  —  FF~ ' 

F-i 


(10) 


„  We  will  show  that  one  need  not  retain  (10).  We  partition  the  matrix 
B~*  into  the  blocks: 


B-i  = 


G 

G 


H 

il 


(11) 


On  the  basis  of  (10)  and  (11)  the  column  BlQA  which  is  added  to  the 
matrix  has  the  following  form: 


{  —  GFF- 1  +  HF-' 
!  -  GFF  '  +  TlF' 


(12) 


1  The  initial  number  of  unknowns  is  not  increased  in  practice.  Since  the 
identity  matrix  of  the  initial  basis  is  usually  not  retained  in  explicit 
form,  we  exclude  in  the  course  of  constructing  a  natural  initial  solution 
the  same  number  of  columns  as  the  number  of  columns  added. 
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In  fact, 


We  easily  compute  the  increment  B-'QaP  with  the  aid  of  (12). 
from  (8)  and  (11) 


B-'QAP 


(--  GFF-'  +  HF~')AP 
(—  gTf-'  4-  HF-')AP 


We  will  show  further  how  the  solution  to  the  dual  problem  is  obtained. 

The  numbers  in  the  first  row*  of  the  submatrices  Cl  and  (H — GF)F~l 
of  the  finite  matrix  (5),  augmented  by  column  (12),  are  the  optimum  values 
of  the  dual  variables,  where  the  first  ones  correspond  to  inequalities 
and  the  remaining  ones  to  equalities. 
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1  We  assume  that  the  coefficients  of  the  objective  function  appear  in  the 
first  row  of  matrix  A. 
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